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PURPOSE: To provide a versatile image data base 
device by enabling automatic extraction from an image 
by using a concept of higher level as a key word and 
lightening the operation burden at thie time of 
registration, and enabling even an image which does not 
match with a state transition model to be registered and 
retrieved. 

CONSTITUTION: The image data base device divides an 
input image inputted by an image input part 1 into 
segments, converts an image feature quantity of each 
segment calculated by an image feature quantity 
calculation part 7 into a scene description language by a 
scene description language conversion part 8. shifts the 
scene description language of each segment to a 
concept of stratum as high as possible by a state 
transition part 10 on the basis of the state transition 
model, and registers the final state of each segment and 
the scene description language of a segment having no 
state transition as key words in an image data base 1 1 
by a data registration part 12 together with the input image. 
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* NOTICES * 

JPO and NCIPI are not: responsible £or any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] An image storage means to match an image with a keyword and to memorize it, and an image 
input means to input an image. The image division means which carries out field division of the input 
image, and an image characteristic quantity calculation means to calculate the image characteristic 
quantity of each divided field, A scene description language conversion means to change image 
characteristic quantity into a scene description language, A state-transition model storage means to 
memorize a state-transition model, and a state-transition means to perform processing which makes the 
condition of each field change to a high order hierarchy as long as the scene description language of 
each field suits the transition Ruhr of a state-transition model. About the field where the condition 
changed by processing of the above-mentioned state-transition means, make the final state of this field 
into a keyword, and a scene description language is made into a keyword about the field where a 
condition did not change. Image database equipment characterized by having the registration means 
made to memorize to the above-mentioned image storage means with the above-mentioned input image. 
[Claim 2] A retrieval demand input means by which a retrieval person inputs a retrieval demand, and a 
retrieval demand analysis means to create the retrieval keyword at the time of analyzing the inputted 
retrieval demand and performing a search. While having further an image retrieval means to search an 
image fi-om an image storage means according to the above-mentioned retrieval keyword, and an image 
presentation means to show the image of a retrieval result to a retrieval person When the above- 
mentioned retrieval demand analysis means is in the condition that the inputted retrieval demand exists 
in a state-transition model While the transition Ruhr is gone back fi-om this condition and this condition 
and the above-mentioned image retrieval means is passed by making into a retrieval keyword all the 
conditions that can reach When the inputted retrieval demand does not exist as a condition in a state- 
transition model Image database equipment according to claim 1 characterized by passing the above- 
mentioned image retrieval means by making into a retrieval keyword the scene description language 
which the retrieval person was made to input a scene description language as a retrieval demand with a 
retrieval demand input means, and was inputted. 

[Claim 3] It is image database equipment according to claim 1 with which the above-mentioned 
registration means is characterized by making it memorize to the above-mentioned image storage means 
by making the above-mentioned positional information into a keyword about the field where the 
condition changed by processing of a state-transition means in addition to the above-mentioned final 
state while a scene description language includes the positional information which shows the location of 
each field in an input image. 

[Claim 4] In case the above-mentioned image retrieval means searches an image according to a retrieval 
ke)word, when a retrieval kejrword is in the condition in a state-transition model While giving a score to 
the image which has a retrieval keyword and a keyword in agreement according to the hierarchy in the 
state-transition model of this condition, when a retrieval keyword is a scene description language The 
scene description language in which it moves and the condition of the lowest hierarchy of the state- 
transition model which can reach has the keyword of the image memorized by the image storage means 
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to the transition Ruhr, While giving a score to the image which compares the scene description language 
as the above-mentioned retrieval keyword, and is memorized by the above-mentioned image storage 
means according to whenever [ coincidence ] Image database equipment according to claim 2 with 
which the above-mentioned image presentation means is characterized by showing the image to which 
the score higher than a predetermined score was given as a retrieval result. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use o£ tlixs translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
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3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention accumulates image information in large quantities, and relates to 
the image database equipment which carries out automatic extracting of the keyword from an image 
especially in the case of registration of an image about the image database equipment with which an 
image can be searched by giving a keyword. 
[0002] 

[Description of the Prior Art] The expectation for the image database equipment for searching a required 
image efficiently from the image information accimiulated in large quantities in recent years is growing. 
Although the image database equipment with which the image corresponding to this keyword is 
extracted is known if a registrant registers into coincidence the keyword which is the semantic 
information on that image by manual input and a keyword is inputted by the retrieval person at the time 
of retrieval in case an image is registered conventionally Since it is not efficient that a registrant inputs a 
keyword manually to all images, the various attempts for performing automatic extracting of a keyword 
from an image are made using image recognition or an image comprehension technique. 
[0003] As such an attempt, for example, the image database equipment with which (1) retrieval person 
inputs a sensibility word and the image corresponding to the sensibility word is searched ("image 
retrieval which was adapted for subjective similarity": the Information Processing Society of Japan 
paper magazine, Vol.31, and no.2 (1990) reference), (2) The image database equipment ("the image 
database in consideration of keyword automatic extracting": Information Processing Society of Japan 
technical report '91 -valve flow coefficient-73-1 reference) using a state-transition model etc. is known. 
[0004] 

[Problem(s) to be Solved by the Invention] However, the above-mentioned conventional configuration 
(1) and (2) have the following troubles, respectively. 

[0005] First, it is the configuration of creating the map to the sensibility word which reflects a user's 
subjectivity scale from the color description which an image has based on a sample image, and referring 
to tiie equipment of the above (1) by inputting this sensibiUty word at the time of retrieval. For this 
reason, while choosing and using the suitable sample image for map creation time, since a sensibiUty 
word is subjective, it is lacking in versatility, and it has the trouble that adjustment of a map is required, 
by the retrieval person. 

[0006] Moreover, it has the trouble that it is lacking in versatility since the extract of a keyword is 
completely dependent on a state-transition model, and it cannot refer to the equipment of the above (2) 
at all to what does not correspond to a model since a keyword is not given. Moreover, at the time of 
retrieval, it is required for a retrieval person to input only superordinate concepts, such as "soccer", as a 
kejrword, scene description becomes a thing only depending on a model, and a retrieval person's volition 
is not reflected. 

[0007] This invention aims at realizing the high image database equipment of versatility while it was 
made in view of each above-mentioned trouble and can extract the keyword of more advanced 
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conceptual level from an image automatically at the time of registration of an image. 
[0008] 

[Means for Solving the Problem] In order to solve the above-mentioned technical problem, the image 
database equipment of this invention according to claim 1 An image storage means to match an image 
with a keyword and to memorize it, and an image input means to input an image. The image division 
means which carries out field division of the input image, and an image characteristic quantity 
calculation means to calculate the image characteristic quantity of each divided field, A scene 
description language conversion means to change image characteristic quantity into a scene description 
language, A state-transition model storage means to memorize a state-transition model, and a state- 
transition means to perform processing which makes the condition of each field change to a high order 
hierarchy as long as the scene description language of each field suits the transition Ruhr of a state- 
transition model, About the field where the condition changed by processing of the above-mentioned 
state-transition means, make the final state of this field into a keyword, and a scene description language 
is made into a keyword about the field where a condition did not change. It is characterized by having 
the registration means made to memorize to the above-mentioned image storage means with tiie above- 
mentioned input image. 

[0009] Image database equipment according to claim 2 is set to equipment according to claim 1. A 
retrieval demand input means by which a retrieval person inputs a retrieval demand, and a retrieval 
demand analysis means to create the retrieval keyword at the time of analyzing the inputted retrieval 
demand and performing a search, While having further an image retrieval means to search an image 
from an image storage means according to the above-mentioned retrieval keyword, and an image 
presentation means to show the image of a retrieval result to a retrieval person When the above- 
mentioned retrieval demand analysis means is in the condition that the inputted retrieval demand exists 
in a state-transition model While the transition Ruhr is gone back from this condition and this condition 
and the above-mentioned image retrieval means is passed by making into a retrieval keyword all the 
conditions that can reach When the inputted retrieval demand does not exist as a condition in a state- 
transition model, it is characterized by passing the above-mentioned image retrieval means by making 
into a retrieval keyword the scene description language which the retrieval person was made to input a 
scene description language as a retrieval demand with a retrieval demand input means, and was inputted. 

[0010] In equipment according to claim 1, image database equipment according to claim 3 is 
characterized by for the above-mentioned registration means to make it memorize to the above- 
mentioned image storage means by making the above-mentioned positional information into a keyword 
about the field where the condition changed by processing of a state-transition means in addition to the 
above-mentioned final state while a scene description language includes the positional information 
which shows the location of each field in an input image. 

[001 1] Image database equipment according to claim 4 is set to equipment according to claim 2. In case 
the above-mentioned image retrieval means searches an image according to a retrieval keyword, when a 
retrieval keyword is in the condition in a state-transition model While giving a score to the image which 
has a retrieval keyword and a keyword in agreement according to the hierarchy in the state-transition 
model of this condition, when a retrieval keyword is a scene description language The scene description 
language in which it moves and the condition of the lowest hierarchy of the state-transition model which 
can reach has the keyword of the image memorized by the image storage means to the transition Ruhr, 
The scene description language as the above-mentioned retrieval keyword is compared, and while giving 
a score to the image memorized by the above-mentioned image storage means according to whenever 
[ coincidence ], the above-mentioned image presentation means is characterized by showing the image 
to which the score higher than a predetermined score was given as a retrieval result. 
[0012] 

[Function] According to the configuration according to claim 1, the image characteristic quantity 
calculated from each field of the divided input image is changed into a scene description language. As 
long as the scene description language of each field suits the transition Ruhr of a state-transition model. 
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the final state of the field about the field where the condition of each field changed [ in ] to the 
superordinate concept, and the condition changed as a keyword Moreover, about the field where a 
condition did not change, the scene description language of the field is memorized by the image storage 
means with an input image as a keyword. 

[0013] Since a scene description language is automatically given as a keyword and is memorized by the 
image storage means also to the image which has by this the concept which does not suit a state- 
transition model Since a registrant does not need to give a keyword in case an image is registered, while 
becoming possible to mitigate a registrant's activity burden, if a scene description language is given as a 
keyword, the above-mentioned image can be searched at the time of retrieval. That is, flexible retrieval 
is attained while the versatility of image database equipment improves, since the class of image in which 
storage and retrieval are possible is not Umited with the state-transition model which image database 
equipment holds. 

[0014] When the retrieval demand which the retrieval person inputted exists as a condition in the state- 
transition model which image database equipment holds according to the configuration according to 
claim 2 The transition Ruhr is gone back fi-om this condition and the above-mentioned condition. All the 
conditions of the low order hierarchy who can reach An image retrieval means is passed as a retrieval 
keyword, the image with which an image retrieval means has this retrieval keyword and a keyword in 
agreement is searched fi-om an image storage means, and that retrieval result is shown to a retrieval 
person. On the other hand, when the retrieval demand which the retrieval person inputted does not exist 
as a condition in the state-transition model which image database equipment holds, the scene description 
language which the retrieval person was made to input with a retrieval input means is passed to an image 
retrieval means as a retrieval keyword, and an image retrieval means searches an image according to the 
scene description language passed as a retrieval keyword. 

[0015] Even if it is the case where retrieval of the image which does not suit by this the state-transition 
model which image database equipment holds is required, a scene description language is made to input 
as a retrieval demand, and it becomes possible to search an image according to this scene description 
language. Consequently, it is lost with image database equipment that the class of image in which 
storage and retrieval are possible is limited with a state-transition model, and it becomes possible to 
raise the versatility of image database equipment. 

[0016] According to the configuration according to claim 3, about the field where the condition changed 
to the high order hierarchy by processing of a state-transition means Since the location in the input 
image of the field is registered [ final state / of a field ] with an input image as a keyword In case it 
searches, when a retrieval person performs the assignment a "person" as a condition of a "center section" 
and a field as positional information, it becomes possible to give the conditions of "the image with 
which a person exists in a center section", and to search an image. Consequently, retrieval effectiveness 
can be raised, while becoming possible to search by directing more concretely flie image image for 
[ which the retrieval person is holding ] retrieval to image database equipment and attaining the flexible 
retrieval in which a retrieval person's volition was reflected. 

[0017] According to the configuration according to claim 4, the image searched as a retrieval keyword 
the condition in a state-transition model The image searched considering the scene description language 
as a retrieval keyword by giving such a high score that a hierarchy becoming high according to the 
hierarchy in the state-transition model of the above-mentioned condition The scene description language 
which goes back the transition Ruhr fi-om the keyword of the image memorized by the image storage 
means, and the condition of the lowest hierarchy of the state-transition model which can reach has. Only 
the image to which the scene description language as the above-mentioned retrieval keyword was 
compared, such a high score that whenever [ coincidence ] becomes high was given to, and the score 
higher than a predetermined score was given is shown as a retrieval result to a retrieval person. 
[0018] Since the high image of possibility are the image for which a retrieval person asks will be shown 
by this, while becoming possible to raise the retrieval effectiveness at the time of a retrieval person 
choosing a desired image from the image shown as a retrieval result etc., possibility that the image 
which was widely different from the image for which a retrieval person asks will be shown can decrease. 
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and the dependability of image database equipment can raise. 
[0019] 

[Example] It will be as follows if one example of this invention is explained based on drawing 1 thru/or 
drawing 6 • As the image database equipment in this example is image database equipment with which a 
color picture is registered and searched and is shown in drawing 1 as a configuration about registration 
of an image The image input section 1 (image input means) for inputting the image database 1 1 which 
accumulates an image and its keyword, and the image registered into a database. The input image 
memory 2 for accumulating the image inputted from this image input section 1, The limited color image 
creation section 3 (image division means) which divides the whole image into two or more fields, and 
creates a limited color image while inputting the full color image accumulated in this input image 
memory 2 and carrying out subtractive color of that color number, The limited color image memory 4 
which accumulates this limited color image, and the labeling section 5 which carries out labeling of the 
above-mentioned limited color image, and creates a labeling image. The labeling image memory 6 
which accumulates a labeling image, and the image characteristic quantity count section 7 (image 
characteristic quantity calculation means) which calculates the image characteristic quantity of each 
field. The scene description langxiage transducer 8 (scene description language conversion means) which 
changes image characteristic quantity into a scene description language, The state-transition model 
database 9 (state-transition model storage means) which accumulated the Ruhr for the condition of each 
above-mentioned field to change. It has the state-transition section 10 (state-transition means) which 
makes the condition of each field change, referring to this state-transition model database 9, and the data 
registration section 12 (registration means) which registers the input image of the input image memory 2 
to the above-mentioned image database 1 1 with a keyword. 

[0020] Here, a state-transition model is explained. It is a model for bringing more the condition of the 
segment which serves as a state transition diagram as indicated to be a state-transition model to drawing 
6 from the transition Ruhr, and mentions later the actuation in which a condition will change to a high 
order hierarchy as an arrow head shows if the transition Ruhr in this drawing set [ in / for example / 
conditions, such as "Human" and "Human-hair", ] up beforehand is filled by repeating as long as the 
transition Ruhr filled exists close to a superordinate concept. 

[0021] Here, registration of the color picture by the above-mentioned configuration is explained below, 
referring to the flow chart shown in drawing 2 . In addition, in this example, the color picture registered 
presupposes that each element of (Red R), green (G), and blue (B) is the fiill color image expressed with 
the 8 bits (256 gradation from 0 to 255) digital data, respectively. 

[0022] First, the color picture which it is going to register into an image database is inputted by the 
image input section 1, and is accimiulated in the input image memory 2 (it writes like SI step 1 and the 
following). 

[0023] Next, although a body etc. is recognized from this input image, it is necessary to cut down first 
the body which serves as a candidate for recognition from an image for this recognition. Here, since an 
input image is a fiill color image, it uses the technique of color segmentation of extracting the field 
constituted by the same color. That is, create the limited color image which limited the color to 16 color 
extent from the fiiU color input image which the limited color image creation section 3 took out from the 
input image memory 2 (S2), and the labeling section 5 sets in the limited color image created by the 
above S2. The same label is given to the connection field of the same color, and an image is divided into 
two or more fields by making into one connection field the field which has the same label (S3). 
Henceforth, suppose that each of these divided fields is called a segment. 

[0024] Next, the image characteristic quantity coimt section 7 computes image characteristic quantity, 
such as the pulse duty factor and circularity to area, a circumscription rectangle, a color, the direction of 
a main shaft, and the direction of a main shaft:, and a center of gravity, about each segment, respectively, 
and (S4) and the scene description language transducer 8 create the scene description language of each 
segment from the computed image characteristic quantity (S5). in addition, this scene description 
language is in every direction in the magnitude of a segment, and the whole input image — when it 
trichotomizes, respectively and divides into nine blocks, it consists of two or more kinds of parameters 
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which express the block location where an applicable segment is contained, the color of a segment, the 
configuration of a segment, and the direction of a main shaft of a segment, respectively. 
[0025] In S6 continuing, the state-transition section 10 does as follows the activity which determines the 
concept of each segment based on the scene description language of each segment, and the state- 
transition model accumulated in the state-transition model database 9. 

[0026] That is, the state-transition section 10 will make the condition of this segment change to the 
hierarchy on one, if it investigates whether the scene description language created by the above S5 to 
each segment is filling the transition Ruhr of a state-transition model sequentially fi-om the subordinate 
concept of a state-transition model and the transition Ruhr is filled. 

[0027] A state-transition model as shown in drawing 6 is more specifically given, and if the parameter 
which shows the color of the segment in the scene description language of a certain segment is "black", 
this segment will fill the transition Ruhr, will change to 1 hierarchy high order fi-om "Color-segment" 
which is the lowest concept, and will serve as "Black-segment." Furthermore, when the scene 
description language of this segment fiilfiUs the conditions which may be the image of human being's 
hair part, it means that the transition Ruhr was filled fiuther and changes to 1 hierarchy high order to a 
pan. Thereby, this segment is recognized as a segment which has conceptual "Hiunan-hair" that it is 
hvunan being's hair. 

[0028] To the above-mentioned state-transition model, moreover, for the hyperfi-actionation at the time 
of the field division in S3, shading, etc. Since what is originally one body corresponds to the body 
divided into the multiple segment, the body which consists of two or more colors The transition Ruhr as 
the field integrated Ruhr which performs only integration of segments, without making a condition 
change in the hierarchy of a high order is also included comparatively, the segments which fill this field 
iategrated Ruhr are imified, and they are recognized as a segment which has one new concept. 
[0029] A state-transition model as shown in drawing 6 is more specifically given, when the segment 
which has above-mentioned conceptual "Human-hair" as a segment contained in an input image, and the 
segment which has conceptual "Human-skin" that it is the image of human being's skin part exist, these 
segments are unified as what fills the field integrated Ruhr, and it is recognized as one segment which 
has conceptual "Human- face" that it is the image of human being's face part. 

[0030] After it is repeated until no condition of the segments in an input image stops changing, and this 
actuation is completed, the data registration section 12 registers the above-mentioned actuation of S6 
into an image database 1 1 with the image inputted by the above SI by making into a keyword concepts, 
such as the fmal state searched for by the above S6 from each segment, i.e., above-mentioned "Human- 
face" etc., (S7). In addition, about the segment which changed to the concept of a high order rather than 
the predetermined hierarchy, the positional parameter of a scene description language is also registered 
with the above-mentioned keyword to an image database 1 1 at this time. Moreover, about the segment to 
which a condition did not change at all in the above S6, a scene description language is registered as a 
keyword. 

[0031] In addition, with the above-mentioned state-transition model, on the low order hierarchy of a 
state-transition model, the importance of a scene description language becomes low, and the field 
integrated Ruhr is set up so that segments may be unified preferentially, as importance is attached to a 
scene description language, the transition Ruhr is set up so that a condition may be made to change, and 
it becomes a high order hierarchy. Thus, while raising versatility by making a condition change by the 
scene description language on a low order hierarchy, the dependability of recognition is raised by the 
high order hierarchy by seldom depending on a scene description language, but seeing the relation 
between segments etc. globally, and performing a state transition. 

[0032] In addition, here explains creation of the limited color image in the above S2 in more detail based 
on the flow chart shown in drawing 3 . 

[0033] First, the limited color image creation section 3 creates the histogram of a ftiU color input image 
(S21). Since each of R-G-B is expressed by 256 gradation, each color in an image is expressed with this 
example as a point in the cube of the 1 side 256 (from 0 to 255) which is among RGB space. It divides 
into the cube of the this 1 called a eel in the cube of 256 one side side 8. Next, the RGB value of the 
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pixel in an image is calculated, it asks for to which eel the pixel belongs all over RGB space, and only 1 
makes the frequency value of the eel to which the pixel belongs increase. This processing is performed 
to all pixels and a histogram is created. 

[0034] Next, the mode eel which is a eel with the largest frequency value is detected in the created 
histogram (S22), the color which this mode eel expresses is made into a representation color, and the 
color of the eel contained in the ball of the radius to which this mode eel is beforehand given as a core is 
replaced in the above-mentioned representation color. Thus, it repeats until it excepts the eel as which 
the color was determined from an object and an object eel is lost in retum and the same processing to 
S22. Subtractive color of the color mmiber of a full color image can be carried out to 16 color extent by 
making the above-mentioned radius at the time of performing these processings adjust suitably. That is, 
when there is little color number, the above-mentioned radius can be made small, tiie number of the eels 
which can be expressed with one representation color by enlarging the above-mentioned radius in many 
can be adjusted, and the color number can be brought close to the number of hope. 
[0035] Next, as explained above, in order that a retrieval person may search an image from the image 
database 1 1 with which the image is registered with the keyword, retrieval actuation of the image by the 
configuration with which the image database equipment of this example is equipped, and this 
configuration is explained, referring to drawing 4 and drawing 5 . 

[0036] Further in aiddition to the configuration about registration of the image mentioned above, as 
shown in drawing 4 , the image database equipment of this example The retrieval demand input section 
21 (retrieval demand input means) for the retrieval person who searches to input a retrieval demand. The 
retrieval demand analysis section 22 (retrieval demand analysis means) which analyzes the inputted 
retrieval demand. It is the configuration equipped with the retrieval section 23 (image retrieval means) 
which searches the image which corresponds based on the analysis result of a retrieval demand from an 
image database 1 1, and the image presentation section 24 (image presentation means) which shows a 
retrieval person the image searched by the retrieval section 23, 

[0037] In the above-mentioned configuration, in searching the image accumulated in the image database 
1 1, a retrieval person inputs first the name of the structure which constitutes the image to search by the 
retrieval demand input section 21 as a retrieval demand (SI 1). When it explains more concretely and a 
retrieval person, for example, wants to search an image including a person, it is "Human" as a name of a 
structure. It will input. 

[0038] If a retrieval demand is inputted, the retrieval demand analysis section 22 will look for the state- 
transition model database 9. The concept which is in agreement with the name of the structure inputted 
as a retrieval demand by SI 1 If contained in the state-transition model accumulated in the state- 
transition model database 9 (SI 2), retum and the retrieval demand input section 21 will direct to input 
the retrieval demand about the location of the above-mentioned structure in an image to SI 1 to a 
retrieval person. 

[0039] Thereby, a retrieval person becomes possible [ creating a retrieval demand, such as "an image in 
which a person is right in the middle", ]. Consequently, while becoming possible to search by directing 
more concretely the image image for [ which the retrieval person is holding ] retrieval to image database 
equipment and attaining the flexible retrieval reflecting a retrieval person's volition, the effectiveness 
that retrieval effectiveness improves is done so. However, a retrieval person does not necessarily need to 
follow the above-mentioned directions, and can also progress to S13 which is the following step, 
without inputting the retrieval demand about a location. 

[0040] If the concept which is in agreement with the name of the structure inputted as a retrieval demand 
on the other hand does not exist in the state-transition model accumulated in the state-transition model 
database 9 (SI 2), retum and the retrieval demand input section 21 make a retrieval person input the 
retrieval demand by the scene description language into SI 1. In addition, as described above as the 
scene description language, it is the location to magnitude and the whole input image, the color, the 
configuration, and the direction of a main shaft of an object. However, it is not necessary to input these 
[ all ] as a retrieval demand. 

[0041] Thus, when the location or a desired concept does not exist in a state-transition model if needed 
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[ the concept and if needed ] which exist in a state-transition model, a scene description language is 
passed to the retrieval section 23 as a retrieval demand. In addition, the above SI 1 and S12 is repeated 
until a retrieval person ends creation of all retrieval demands (813). 

[0042] In addition, the user interface in the retrieval demand input section 21 for a retrieval person to 
input a retrieval demand For example, if the concept included in the state-transition model in the menu 
screen by GUI (Graphical User Interface) is displayed as an icon and a retrieval person chooses a 
desired thing from these icons According to [ the concept corresponding to the selected icon is able to be 
passed to the retrieval section 23 as a retrieval demand, and ] this, the operability for a retrieval person 
can be raised. Moreover, when the concept corresponding to the structure of a request of a retrieval 
person is not displayed as an icon (i.e., when the desired concept is not included in a state-transition 
model), it can also be directed to make various kinds of parameters of a scene description language input 
in the pictures. 

[0043] The retrieval section 23 searches the image which corresponds from an image database 1 1 based 
on the above-mentioned retrieval demand (SI 4), and the image presentation section 24 presents the 
retrieval result of the retrieval section 23 to a retrieval person (SI 5). 

[0044] Here, the above-mentioned retrieval actuation is explained more to a detail using the example of 
the state-transition model shown in drawing 6 . 

[0045] The retrieval demand analysis section 22 performs processing which is different whether the 
inputted retrieval demand is the concept which exists in a state-transition model, or it is a scene 
description language. Processing when the concept which exists in a state-transition model is first 
inputted as a retrieval demand is explained. Here, it is name "Human" of a structure by the retrieval 
person. As it is inputted as a retrieval demand and shown in drawing 6 , it is "Human" to a state- 
transition model. Suppose that it exists as a concept. 

[0046] When existing in a state-transition model judges the above-mentioned retrieval demand in the 
analysis of the retrieval demand analysis section 22, the retrieval demand analysis section 22 is this 
retrieval demand "Human". It considers as a retrieval keyword and delivery and the retrieval section 23 
search an image database 1 1 based on this retrieval keyword to the retrieval section 23. If the image 
whose "Human" is a keyword is registered into the image database 1 1 as a result of retrieval, let this 
image be a candidate image, ftirthermore, the retrieval demand analysis section 22 — the above- 
mentioned state-transition model — setting — "Human" from — delivery and the image with which the 
retrieval section 23 has this retrieval keyword and a keyword in agreement search for whether it is 
registered with the image database 1 1 to the retrieval section 23 by making into a retrieval keyword 
"Human- face" which is the concept from which only one hierarchy got down to low order, and when it 
exists, the score according to the hierarchy of this "Human- face" gives by using this image as a 
candidate image. In addition, the above-mentioned score is given according to the hierarchy of a state- 
transition model, and a high score is given, so that the hierarchy of a high order is approached. 
[0047] After the lowest hierarchy of a state-transition model goes grant of the retrieval and the score by 
the above retrieval keywords one by one, the image which has a bigger score than the threshold 
beforehand set up among the candidate image and the image which became is presented by the image 
presentation section 24 as an image of a retrieval result to a retrieval person. Moreover, when there are 
two or more kinds of retrieval demands, the image with which the average of the score to all retrieval 
demands became larger than the above-mentioned threshold among the candidate image and the image 
which became is shown as a retrieval result. 

[0048] Next, processing when the inputted retrieval demand is a scene description language is explained. 
Here, suppose that the state-transition model shown in drawing 6 is used. 

[0049] In this case, the retrieved demand analysis section 22 is passed to the retrieval section 23 by 
making the inputted scene description language into a retrieval keyword. Next, what is registered into 
the image database 1 1 as a keyword of a registered image among the concepts in the state-transition 
model of the state-transition model database 9 is chosen from a state-transition model. If only "Human- 
face" shall be registered into the image database 1 1 with the image as a keyword among the concq>ts 
which exist in the state-transition model which is got blocked, for example, is shown in drawing 6 , this 
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"Human-face" will be chosen. 

[0050] And the retrieval section 23 performs the comparison with the scene description language given 
as a retrieval demand in the concept of the lowest hierarchy who reaches by going back the transition 
Ruhr from "Human-face" to a low order hierarchy. In more detail the transition Ruhr in the low order 
hierarchy of a state-transition model Each parameter of the scene description language which is given as 
conditions which each parameter of a scene description language should fulfill, and was given as a 
retrieval demand. The score as a candidate image is given to the image with which each parameter of the 
scene description language as the above-mentioned conditions is registered into the image database 1 1 
by making above-mentioned "Human-face" into a keyword according to whether to be how much in 
agreement. In addition, the score given shall also become high, so that whenever [ each above- 
mentioned parameter's coincidence ] is high. 

[0051] As mentioned above, after performing grant of the comparison and score based on each 
parameter of a scene description language to all the keywords registered into the image database 11, the 
image which has a bigger score than the threshold beforehand set up among the candidate image and the 
image which became is presented by the image presentation section 24 as an image of a retrieval result 
to a retrieval person. Moreover, when there are two or more kinds of retrieval demands, the image with 
the larger average of the score to all retrieval demands among a candidate image and the image which 
became than the above-mentioned threshold is shown as a retrieval result. 

[0052] As mentioned above, the image database equipment of this example divides into two or more 
segments the full color image which the image input section inputted based on a color, and creates a 
scene description language from the image characteristic quantity computed from each segment. 
Furthermore, in case the condition of each segment is made to change to the concept of a high level as 
much as possible and an image is registered into an image database by applying a state-transition model 
to this scene description language, the final state of each segment is registered as a keyword with an 
image. Moreover, it is the configuration of also registering the location of this segment in an image with 
the above-mentioned final state about the segment which changed to the high order hierarchy, and 
registering a scene description language about the segment to which transition to a high order hierarchy 
was not performed at this time. 

[0053] Since an objective keyword is given ** [ according to / a registrant's subjectivity ] while the 
activity burdens of the registrant of the creation time of an image database are sharply reducible, since 
the activity which a registrant gives a keyword becomes imnecessary by this to each of the image to 
register, the effectiveness that the versatility and dependability of an image database can be raised is 
done so. 

[0054] moreover, when searching the image registered by doing in this way and the concept which 
exists in a state-transition model is given as a retrieval demand It searches for whether while searching 
an image database by making this concept into a keyword, the image which made the keyword the 
subordinate concept in the transition Ruhr which reaches to the above-mentioned concept is registered 
into the image database one by one to the lowest concept. When the image is registered, the score 
according to the hierarchy in tiie state-transition model of the concept as a keyword of that image is 
given to the above-mentioned image, and has composition shown to a retrieval person by making only 
an image with this larger score than a predetermined threshold into a retrieval result. 
[0055] Even when the concept as a retrieval demand which the retrieval person gave is not registered as 
a keyword by this, it is possible to raise possibility that the image with which a retrieval person asks for 
the concqpt of the low order hierarchy of the concept since it will be shown as a retrieval result if there 
is an image registered as a keyword will be shown as a retrieval result Consequently, the effectiveness 
that the flexible retrieval based on a more abstract advanced concept is attained is done so. Moreover, it 
prevents that the image for which a retrieval person asks, and the image which was widely different are 
shown since only an image with a larger score than a predetermined threshold is shown, and while a 
retrieval person becomes possible [ mitigating the burden which chooses a desired image ], the 
dependabiUty of an image database can be raised. 

[0056] moreover, about the segment to which a condition did not change with the state-transition model 
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which this image database equipment holds in the case of registration of an image A scene description 
language is registered with an image as a keyword. In the case of retrieval When the concept which does 
not exist in the state-transition model which this image database equipment holds is given by the 
retrieval person as a retrieval demand While giving a retrieval person directions so that a retrieval 
demand on scene description language level may be inputted The transition Ruhr in the concept of the 
lowest hierarchy who can reach by going back the transition Ruhr from the concept registered into the 
image database as a keyword. Each parameter with the scene description language inputted by the 
retrieval person as a retrieval demand is compared, a score is given to the image registered 
corresponding to the above-mentioned keyword according to whenever [ that coincidence ], and this 
score is the configuration of showing only a larger image than a predetermined threshold as a retrieval 
result. 

[0057] Since it becomes possible to perform registration and retrieval by using a scene description 
language also with the image which has the concept which does not exist in the state-transition model 
which this image database equipment holds by this, an image database does so the effectiveness that the 
versatility of an image database can be raised only depending on a state-transition model. 
[0058] In addition, although this invention is not limited to the above-mentioned example and this 
example explained the class of parameter of a scene description language as the magnitude, the location, 
the color, the configuration, and the direction of a main shaft of a segment, it is also possible to make 
other elements into a scene description language according to the class of image registered into a 
database. Moreover, according to the use purpose of the class of image, or a database to register, various 
models are applicable also about a state-transition model. 
[0059] 

[Effect of the Invention] As mentioned above, the image database equipment of this invention according 
to claim 1 An image storage means to match an image with a keyword and to memorize it, and an image 
input means to input an image. The image division means which carries out field division of the input 
image, and an image characteristic quantity calculation means to calculate the image characteristic 
quantity of each divided field, A scene description language conversion means to change image 
characteristic quantity into a scene description language, A state*transition model storage means to 
memorize a state-transition model, and a state-transition means to perform processing which makes the 
condition of each field change to a high order hierarchy as long as the scene description language of 
each field suits the transition Ruhr of a state-transition model. It is a configuration equipped with the 
registration means which makes the final state of this field a keyword about the field where the 
condition changed by processing of the above-mentioned state-transition means, and is made to 
memorize to the above-mentioned image storage means with the above-mentioned input image by 
making a scene description language into a keyword about the field where a condition did not change. 
[0060] Since the class of image in which storage and retrieval are possible is not limited with the state- 
transition model which image database equipment holds while becoming possible to mitigate a 
registrant's activity burden, since a scene description language is automatically given as a keyword also 
to the image which has by this the concept which does not suit a state-transition model, the effectiveness 
that the versatility of image database equipment improves is done so. 

[0061] A retrieval demand input means by which, as for image database equipment according to claim 2, 
a retrieval person inputs a retrieval demand, A retrieval demand analysis means to create the retrieval 
keyword at the time of analyzing the inputted retrieval demand and performing a search. While having 
fiirther an image retrieval means to search an image from an image storage means according to the 
above-mentioned retrieval keyword, and an image presentation means to show the image of a retrieval 
result to a retrieval person When the above-mentioned retrieval demand analysis means is in the 
condition that the inputted retrieval demand exists in a state-transition model While the transition Ruhr 
is gone back from this condition and this condition and the above-mentioned image retrieval means is 
passed by making into a retrieval keyword all the conditions that can reach When the inputted retrieval 
demand does not exist as a condition in a state-transition model, it is the configuration passed to the 
above-mentioned image retrieval means by making into a retrieval keyword the scene description 



http://www4.ipdI.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



6/29/2006 



JP,08-249349,A [DETAILED DESCRIPTION] 



Page lOoflO 



language which the retrieval person was made to input a scene description language as a retrieval 
demand with a retrieval demand input means, and was inputted. 

[0062] Even if it is the case where retrieval of the image which does not suit by this the state-transition 
model which image database equipment holds is required, it becomes possible to make a scene 
description language input as a retrieval demand, and to search an image. Consequently, while it is lost 
with image database equipment that the class of image in which storage and retrieval are possible is 
limited with a state-transition model and more flexible retrieval is attained, the effectiveness of 
becoming possible to raise the versatility of image database equipment is done so. 
[0063] Image database equipment according to claim 3 is a configuration which the above-mentioned 
registration means makes memorize to the above-mentioned image storage means by making the above- 
mentioned positional information into a keyword about the field where the condition changed by 
processing of a state-transition means in addition to the above-mentioned final state while a scene 
description language includes the positional information which shows the location of each field in an 
input image. 

[0064] Since this is enabled to input the body contained in an image as a retrieval demand with the 
location, it becomes possible to search by directing more concretely the image image for [ which the 
retrieval person is holding ] retrieval to image database equipment. Consequently, it depends reflecting a 
retrieval person's volition, flexible retrieval is attained, and the effectiveness that retrieval effectiveness 
can be raised is done so. 

[0065] In case the above-mentioned image retrieval means searches an image according to a retrieval 
keyword, when a retrieval keyword is in the condition in a state-transition model, image database 
equipment according to claim 4 While giving a score to the image which has a retrieval keyword and a 
keyword in agreement according to the hierarchy in the state-transition model of this condition, when a 
retrieval kejword is a scene description language The scene description language in which it moves and 
the condition of the lowest hierarchy of the state-transition model which can reach has the keyword of 
the image memorized by the image storage means to the transition Ruhr, While giving a score to the 
image which compares the scene description language as the above-mentioned retrieval keyword, and is 
memorized by the above-mentioned image storage means according to whenever [ coincidence ], the 
above-mentioned image presentation means is the configuration of showing the image to which ttie 
score higher than a predetermined score was given as a retrieval result. 

[0066] Since the high image of possibility of being the image for which a retrieval person asks is shown 
by this While becoming possible to raise the retrieval effectiveness at the time of a retrieval person 
choosing a desired image from the image shown as a retrieval result etc. Since possibility that the image 
which was widely different from the image for which a retrieval person asks will be shown decreases, 
while a retrieval person can mitigate the burden which chooses a desired image, the effectiveness that 
the dependability of image database equipment can be raised is done so. 

[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsiJble for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 

DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the outline of the configuration for registering an image in 
the image database equipment in one example of this invention. 

[Drawing 2] It is the flow chart which shows the flow of registration processing of the miage in the 
above-mentioned image database equipment. 

[Drawing 3] It is a part of registration processing of the above-mentioned image, and is the flow chart 
which shows the flow of the processing which creates a limited color image from a fiill color image. 
[Drawing 4] It is the block diagram showing the outline of the configuration for searching the image 
registered in the above-mentioned image database equipment, 

[Drawing 5] It is the flow chart which shows the flow of retrieval processing of the image in the above- 
mentioned image database equipment. 

[Drawing 6] It is the explanatory view showing an example of the state-transition model which the 
above-mentioned image database equipment holds. 
[Description of Notations] 

I Image Input Section (Image Input Means) 

3 Limited Color Image Creation Section (Image Division Means) 

7 Image Characteristic Quantity Count Section (Image Characteristic Quantity Calculation Means) 

8 Scene Description Language Transducer (Scene Description Language Conversion Means) 

9 State-Transition Model Database (State-Transition Model Storage Means) 

10 State-Transition Section (State-Transition Means) 

I I Image Database (Image Storage Means) 

12 Data Registration Section (Registration Means) 

21 Retrieval Demand Input Section (Retrieval Demand Input Means) 

22 Retrieval Demand Analysis Section (Retrieval Demand Analysis Means) 

23 Retrieval Section (Image Retrieval Means) 

24 Image Presentation Section (Image Presentation Means) 

[Translation done.] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 6/29/2006 



JP,08-249349,A [DRAWINGS] 



Page 1 of 5 



* NOTICES * 

JPO and NCIPI are no't responsible £or any 
damages caused by the use of this translation. 

r.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DRAWINGS 



Drawing 11 



r 



1^ 



1 0 



Jc CI 



1 ] 



[Drawing 3] 



http://www4.ipdLncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



6/29/2006 



IP,08-249349,A PRAWINGS] 



Page 2 of 5 



\ c:! 



S2 1 



S22 



S2 3 



[Drawing 2] 



http://www4ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi__ejje 



6/29/2006 



JP,08-249349,A [DRAWINGS] 



Page 3 of 5 



SI 



S2 



S3 



5<U >r 



S4 







^S5 








^S6 






^ S7 









C^EEZ) 



[Drawing 4] 



http://www4Jpdl.ncipi.go jp/cgi-bin/ti^_web_cgi_eije 



6/29/2006 



JP,08-249349,A [DRAWINGS] 



Page 4 of 5 



2 1 







^2 2 








m 










[Drawing 6] 



1 L 



SHunan 




IKiDEuHiair Glimii-^o 

I 1 

tSlack-segnmt SSkin-sagnent SCDlared-scgnent 
[Drawing 5] 



http://www4jpdl.ncipi.gojp/cgi-bin/tran_web_cgi_eije 



6/29/2006 



JP,08-249349^ PRAWINGS] 



Page 5 of 5 




S 1 1 



S 1 2 



S 1 3 



SI 4 



S 1 5 



( ) 



[Translation done.] 



http://www4ipdl.ncipi.gojp/cgi-bin/tran_web_cgi_ejje 



6/29/2006 



(19)H*B#ifit (JP) 



<12) ^ M 4# 11^ ^ $B (A) 



#g|¥8-249349 

(43)^18 H 8 ^(1996)9 ^270 



(51) Into.' mifs.^ ;ri*gsa»^ Fi ^it^mm 

G 0 6 F 17/30 9194-5L ' G 0 6 F 15/40 3 7 0 B 

9194-5L 15/401 3 1 0 A 



iFsw^ mm^ m^m<osc4 ■ ol (^ ii h) 



(21)ffiB#^ 


4*H¥7 -54794 


(71) max 


595037261 










«rt IE* 




(22)fflHB 


¥di 7 <^ (19^3^143 




♦«?/tI»«SmiMIK§l 2 -56 - 


7 








000005049 




















:*:Efl¥:*:ETff|5r«IPEg&Br22#22# 








(.72mmm 


«W IE* 










W^5;iim«S*1WIEflL*SS2 -56- 


7 


















:*:E^E7PPJ«IPKS«IBT22#22# 


















(74) A 







(54) mmco^m mmy'-^^-T.&s. 



(57) [S!^] 



BBIAMS 



3^ r 



1 0^ 



1 2^ 



<tBgJF 8-249349 



V^TI^->->'i2iii!iWf§tr=^5—^?- Kt L-C. ilBA;^)® 

[sil*«2l tfe^#;Js«l*^**A;^)-r5«l^^*A;'3 

^St, A;:^i$ixfc^^!i*^ftfWUTlt^^*fTi-5 

A;'3^?tufc^*^*^st^l!8S»*7^/i'tf»;^ttligirL 

«e<D^^i:E^S^^■rta:H^t«Sr^tpi:*^;I. ±IESS^S 

- L-C±l5iIi«ia«#S'-iait$-e:5 r t t 

-r 5 if 1 IE«c S^x - >^ iSMo 

^immmt^tt^L. ^(r>—mm\zt^^\:.x±m<r>mme. 
m^mzum^)xx\,^^mmcni^^H^i-?> tmz. 



2 

[0 0 0 1 ] 

ziKox'^^m^T'—s'^-^mm.i^imi.. mc. 

10 0 0 2] 

til, ^<OBi»(OS*6<]'itt«T'te5=^-!7- 

KSr#-li)A;^{-J:oTI^B#|cl^gfeL, 

•f^x(r>nm^n\^xmM.^ti-^—v—Y^^ 

itiA;'3-rS<Dtt^*6<)T-Jtev^fcfe, W^^ili^lS^S^ 
fi^«Srffl</^-C. iiiifed-b^-!7-KroSi(itttH«rfTP/:i 

[0 0 0 3] rcoip'Jc^^t L-r. 0iJx(i, (1) 

fzM'^^n\ : '^m.vm.^^^-nM, voi.31.no. 2(199 

0) (2) «^^i^^T'/^^fflv^fcii^^T'-^ 

f>^-7.\ : if ««iai^#Sai • 91-CV-73-l#ra) ^;5S 
[0 0 0 4] 

[000 5] ±ia (1) roi^e-eii, h^osfo 

[0 0 0 6] Sfc. ±12 (2) oi2IHT-|i. *-!7-K 

-h'tLXXtt-rh^tt^-a^SX-^*) . >-BEiE»l^ 
» [000 7] *«igi4±SLfc#raS;felili£^<t$Jxfc 



f$Ba^ 8-249349 



3 

[00 0 8] 

Sir, Pi^SrA;^»i-51(^A:^^Si:. A;^iif^Sr««c 
[0 0 0 9] l»*S2|Ettroiii^x-^'<-;^^@(4, 

i-^^mm^x:tj^mt. A;^)$nfc^$«^*^fiiWL 

•t-'<T^«i^df~i7- Ki: i.x±se.mm^m^wc^m-r 
i:^-y->^mmm^^mm^t l-ca;^$-b:. A;ti$ 

[0 0 10] if*]S3iE®diij^7'-^'-i-^i?gl±. 
it*9iia^w^eic:*3VNT. ->->-tE2Em^Jb^ A;^ 

[0 0 11] ii*^4|EttOffii^v^-^'-~t->^.Sgg(4, 

h'tiiikmm^'f:r/i^'p<Di^mx'hi>m-tiat.. 



4 

mm^-v-h'r--y->'m^mmx'ih^m't\at. 

10 [0012] 

[f^ffi] st*^lfE«fe(Dlffife(cJ;ix(^, ^m^titzAt) 

- Ft LTA;^ii^t*lciii^lStt^Sli|21i$nSo 
[0 0 131 rtbidj;!?. <*liS^^7'/H;ijS-g-U'5cv^ 

-h't i.x^mmm^^itixmiSimm^mzmm^ti 
-v-h't i.x^7Ltnt±^mm<r>^mt:nj^ti'-x' 

-rfii^h. fait • «l**s^|g<ciii{fecoaS:SS®iS 

mm^'e7'^i"p\cvtmt\^x^^i-i,m^\z{:i.^ ^<d^ 

imm<r>Hkm<^i-^xtii. m^^-i7-Kt LrB® 
« ei5i5#irgimA;ti^&lcj:9A;^S-arfc->-:^IEi$ 

m^m^ma. i!km^-^-h't\^xm^titL->-'^n. 
[0 0 1 51 micit), m^T'-^^-^mmi'-^^ 

^fixfcS-e-r-ifooTt. V->-|B;®S^?:gl5^g*t L 
so J:>JBS^$n5ri:is/i</£!J. iBlfe7'-^'^-;^^IB 



§3^ 8-249349 



5 

[0 0 161 mM^zwm.<omm^^f\.\-i. m&m^^ 

ty^^o^kifiF^^TLxm^^^m't^z.tfi^^^tf^^oo 

^m^i)m^^x\^^^^mn^(om^^ ^-'y 

[0 0 17] m^m4^m.(Dmmcx^\t. -^mm^^ 

^mm^^.m^-'7-vt\^x^m^i^timm\t. 
-ji^^mnLxmm'^m^j:ikmm^^fy^(DmT{tLmm 
tLx<oi^->^tm'mmtt:]tm\^. 't<D-'Wcmr-^< 

[0 0 18] ^m^^mm-r^mi&xhb 
tmm'^^t Lxm7r:^tifzmm>hmm<Dmm^m^ 

[0 0 1 9] 

«fig^LT. 1^1 ic^i-J: mi^ftcD^-^-h' 

\^^it>^miSL±i^^m^(Dmmc^m\^xm^&m^%: 



(4) 

6 

[0 0 2 0] wCT% ^t^Slig^^x/l^lCoVNTIftP^-r 

m^/l^—/i^t^^hti:^. "Huma 
n" . 'Human-hair''^(?:)t^fii(CioV>T. ^i^lS:^ $ 

[0 0 2 1] rrT\ ±f&co«j*lcJ:5:<7 7— lii^(7>^ 

;5?7 7-M^{i. (R) -m (G) (B) 
ii^^tl^*tlS\i^y h (Of)^h2 5 5t.X<D2 5 6Pim) 
(Dr^^ iP^/i^7'—^xm^^titzyji':^y—m^Xh^ 

[0 0 2 2] m^y'-^^-y^\^^m\^xo ti- 

^^y-mmmi^A:hUl\^^r)At}$tiXAtimi^ 

30 [00 2 31 m^. :i(07<timmf)^hmi^^^mm,'r^ 
f:>nxh^f)^. ^(D%nm<Dtz^b\z\t. ^-r, wa^^^^hm 
^n^t^j^^^f^^m^i^i-iE^m^-h^o ^^x\t. A 

timiSi\±y y—m&xh^fzi^. I^ CJ: 5 ?ifetcJ; 

:^iii^p«"=ey 2 7&^bSi»5fflLfc>^/u:*r7— (OA;^®^^* 
1 6feSSJ^fe^PH:^L/cPS^fe®^^ft^L (S 
2) . 7-<y V>/?l5 5;ei^ ±BSS 2r'f^^^ixfcK^fe 

^iJ^ic^^l^T. m-&(omf^mm^yi^\^xm-'<oy-<ji' 

■rsr i:l^J:'9]ij^^1SSco®«J^:»'fi|i-5 (S3) « 
J^m. ztih(O^Pl^titzm^(D-tri^^tii:'^^^ > h 

[0 0 2 4] m^'^mmn^uiJbK 

ixffffiu (S4) . ^/-visi^mfi'^^ass;^^ nm^ 
f^^-r^ (S5) o rcov— ^^iei$m^Ji> ir^/ 
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ti^y'u^y^iiLm. ir:/>>'h<Dfe. iz^;<l^h(Dm 
[0 0 2 5] ^< S GT'li. 0;i^ ^ir>/ 

10 0 2 6] ^mm^m ojt. #-t>r^>' 

10 0 2 7] ct «9 EI 6 tC:^t- <t 0 ^<C*t^a 

i:?^^*?> ^TU<OWiitXh^ " Color-segment' ipg 
S±ffi-'®^LT "Black-segment' -So ^ 

<omUX fc ^ t V ^ 9 m.'t: "Human-hair' ^ ^f-T -5 ir 7« 
[0 0 2 8] ^fz. ±Mo:>i^mm^'^y'Mc\'t^ sz\c 

-fl--fei/7<>h<if9 U(^®C'a^(D;^f^tf ptl^i^«t'g^/^-/^' 
[0 0 2 9] J: t) H 6 {c^r i: p 

LT. ±tSCDlK.-t:''Human-hair'^^r-f -S-ir^^ :/ b <?:> 
Ara<^^SP5J'tO(S^T'fe 5 «t V ^ 9 "Human-skin' 

P8lOMgP5J<^®&T*fe5 ^ 9 ia;t: 'Human-face' 
[0 0 3 0] ±IS L^h S 6 (7)i!)f^{i . A:^l^^4'<^'t*-< 

flt>hm7L ±fe<D 'Human-face' ^ CDffiJji: ^ ^ — 17 — K 
^LT. ±ias lTA;b$tbfc:li«^^lC®^7'-^-< 
(S7) 3 /j^io. gf^o 



5 

IS S 6 ^c:^JV^rt^^;^^^ < iS^ L7i^;^i-o /cir ^ ^ >- h 

So 

[0 0 3 1 ] ft^^ ±l5Ufc^^Slil^-^'7"VuTi^. 

iffiP^Ji s ^^^^ V ^ ^^laa^ws^/^s^ttfiiB: < 

ffl^t^iibi^S-S'. ifiAPgST-fiv— >'ISi!iWf§lc$>^ 

[0 0 3 2] /^ib\ c:iT% ±ISS 2tciott5PI^feiij 

[0 0 3 3] ^-f. PSSfeW^f^^SiJ 3 fl, >^/V;&7- 
OAti®^(^t;^ h^^A^f^;S-r6 (S 2 1) , 

:®0iiT-ii. R • G • B(D^n^'n;65 2 5 6P^^-e^m^ 

5 6 (075^?> 2 5 5) <^5::&($:«t'(7);^.^ LT^^nSo 
-^rcoiij^ji'^RGB^rai^T^^coiryuicS-t-S^i^^* 

[0 0 3 4] ^^fctc. f^^SHfct;^ h^^A4^T% *t 

2) . z(Dmmm'^^\^<om'r&^itm&tL. ztDMcm 

^v>#-g^(c(i±f5¥SSrAt <-rsr ^icj: 19 lo 

[0 0 3 5] ^Ic. i^±tc:IS^LycJ: 5t:^®^d5^-l7 
- K^^{c^&$nTV^Sili^x-^-<->^ 1 1 

10 0 3 6] *llffi«0®ftx-^-<->^ilSll. ffifiS 
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[0 0 3 7] _hlS<7)1»^^-^b^V^r. m^y"-^^-:^ 1 

mf&Lx\^^^m^^(o^w^^mmjf^t \^xAti-r^ 

^i;^ LT 'Human" tAtji-^^t\Zfj::5. 

[0 0 3 8 ] ^mw^:^-Ati^t\^^ t . t^mw^m^u 

2 2r^'Ji^mm^^'r/i^v'-i^^-y^9^mmi^s S 1 1 

xmrnm^t i.xAti^fifzmf&m^^^t-scir^m 

'ikmm^'^y'M^^^tix\^^h.{'£ (s 1 2) . Slid 

[0 0 3 91 CntClit?. ^m^\^. ^iJxH r^ff^icA 

"^mtf^ho ^t^^m. ^m^tm^^x\^^^^mn^(o 

[0 0 4 0] ^mmMt{^XAti^tltim^^(D 

^^^tiTv^^^^ttS^^x/ut^^ffiL^.ettti.f^ (SI 

2) . s 1 i^m^ . mmm^xt}^2 i^K i^-i^m 

-zy^mmmtn. B5l5UfcJ:9tc, 

T-feSo tifzi.. ^mm^^t 1.x zti^'r-<xi:Ati't 

[0 0 4 1 ] Z(DXoK\^X. i^S^S^T^/^tCl^aE-r 

^Wtitt'£^m\c^^CX^<D&mi. fc-5v^fi. 0fM(Da--g; 

S 1 lioJ:l/S 1 2{1. :fe^#j5^-r'<T(OM^M*(Of^ 
^^^T-T'S^T-iS^'Pjg^n^ (S 1 3) o 
10 0 4 2] <^^#d?«ISM4t^A:^i-5fc«)0 



|5iJ;ttfGU I (Graphical User Interface) 

^ - ^ - V ^ r t^Sil^ ^ -r/i- ( - ^ ^ ti > 5 ti 

^xcom'^^^i^^^'^^ztfi-xt^o ^tc. i(kmm 
y ?^-i^^At}^^^x^mmxm^-r^zthx^ 

[0 0 4 3] ^^35 2 3 1^. ±|SLfc1t^^*JcS-^l> 

TM^x-^-<-;^ 1 i^^bf^a-r^a^^^^^L (S 

14). mmmTT^^ 2 4 ;is^t*gi5 2 3 (Dmmf^W:t:^m 

(s 1 5) o 

[0 0 4 4] rrT% me\C7jk-t^mM^'^y'ji^<Dmi: 

20 [0 0 4 5] mmm^M^^ 2 2 fi. A:h^fitimmm 

-^T'{i. «l«#{Cj;oT. 'Human-' 

MCWxman t-m.^t\^X^^\.X\^^^t-th. 
[0 0 4 6] 2 2 0»tffl:i J: "9 . 

30 :^^S*iSffi^«fB 2 2 rOi^^gjJ^ 'Human' *rl^ 

m^—v—vt\.x^m%2 3^m\^. ^m^2z\^z 

m^^o mm(Df^^s miSiy'-^^-:^! It^ 'Human' 

^'^^-9—h'xh^mm^^^^^rix\^^ti{t. mmiMi^ 

iKfliS^^X/^(-*3V>r 'Human' 1 Kg/c^tTfifc-- 
T "9 fc«;g:-Cfe 5 'Human-face' Ki: LT 
1$^gi5 2 3 '-SL. 1^mgiS2 3{irc7)^t^:3r-7- 

^ l^M® ^ t L T r O 'Human-face' (D^M {ZJt^llfc 

[0 0 4 7] ±m(DXo^j:^m^-'p- hicx^mm^ 
«isi5^^oij^<i: i.xm^m7r^s^2 4\cx^x^m^^ 
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[0 0 4 81 d:\c^ At}^titz^m^*^'^>'->'Bji^m 
[0 0 4 9] Z<Dm^. 2 2 At}^ 

xmwr—^^-^i i\^^m^tix\^^^h(7:>t'^^mm 

MM^'^y'/^ (-#ffi-t- 5 . "Human-face" (D^tt 
=^-17- Ki: LXmi^tmrn^v'-i^^-:^ 1 1 1'^ 
^SttXV^^ t <7) t . >1(7:> "Human-face' ;6^iltR^ 

[0 0 5 0] ^ LT. 2 3 "Human-face'' 

"Human-face" 17— h' t LTilf^T^— ^ 

[0 0 5 1 ] ±|Sc7)J: 

^(DWiSLt \.xmiSLm7jkU2 4{c2:'oxitkm^^m^^ 

^t^j:ofzmiMi(D[^. -r-<x<Dip.mmmcni-^n.^.^ 

[0 0 5 2] j[^±(7) i 9 {z^ ^mm&\<Dmmy'-^^- 

p. s m L fell ^ - VlS^Wfg ^ f^^-f 5 o 

S C ^ Jc J: o T^-fe V h 0*tfll^^tg/^l5 ii5 



12 

[0 0 5 3] mim.-t^m^o:>^Az\z^{^x 

m:m^i)^^^-v- v^H^-rhv^mfi^^-mtti^cox^ 

[0 0 5 4] ^fc. rcoj: 9(-LT^^^n/ciiJ^^<^ 

[0 0 5 5] J: . ^m^f}^^^tz\kmm^t u 

t.. ^(Dm.it<DTm^m(owi±.^^-'y-Yt\^x^m 
^t\.x\^^hmm^^fi\'i^m^^^t L-rs^^ns/c 
JC). mm^<Dmmrr^mmmm^^^t\^x^7ri^Hh 

m1k^fsimm.^m^^zm-5\^^fz^Wl^mt^^^^ t fj: 

[0 0 5 6] 4fc. M&o^g^c>^(c. ^ciS^T'-^--^ 

ten. i^->m^nmi^^/^x<D^mw^^At)'r^x 
tkm^\c^^i^mm^t\^xAti^ix 

[0 0 5 7] rixJcJ:D> *lite7^-^-<-^iiad5» 
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[0 0 5 8] 4^*5. ^%ma±.mm^m\z.m-^^n^ t 

4^, *5j;t/^$i;^rS]i LTIft0^Lfc;ii^ 7^*-^-<-;=^t>i 
SSi- 2> Hit coffl^ icfc;; c T c wtewM^ ^ ■>— ^-lea! 

[0 0 5 9] 

®^7='-^"<-;^^Ml±. ilii^*^-!7- Ki:*j-jt£;-^(t 

SS^SroaiSlc: J: o r Lfcfig*gc{c:ov>-Cfl 
[0 0 6 0] <^IB)l^*x/H;i]g-a-L/iV^ 

©Aligns iii^y'- ^ ^- X mm.fimn-r s t^^s^ 

[0 0 6 11 if*^2fE«t01i^x-^-<-^SgSI±. 

A;^ $ iifc«^S*i65«imS#^x>'i''f ■& 
i^^TL-CSI^•5Iig/£t^^Si-'<Tlr^^^-I7- Kt UT 



i4 

[0 0 6 2] rtticio, m\^y'-^^-:^mm.tmw 

rA;'3$-e:T®«©^$^S:fT9ri:;i5pj^i:/£5„ 
[0 0 6 3] 3 fB^coiB^r'- ^ -^-^^gfi, 

[0 0 6 4] iiviiit). mm-K-^t-^^iiiiW-^^nu 

[0 0 6 5] it*:«4|E«(?3iB^x-^'<-^Siai±, 
jSC-c, «l^ds^-;7- Kt-e:i-5#-i7- K^*-r5 

mt. ±.wikm^-'p-YhL.x<D>'-i^fdMmmt^ 

[0 0 6 6] rJxtcJ;^), ^^#;65^li-r5Si«T'fcS 
[HSOfSfm^'^lil^] 

[n 1 ] ^^m(r>-nmm\^isi'f^m^7'—$'-<-:^m. 
so Dy^^a-c-fca, 
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[0 2] ±mmiMiy'-^^-y^mw:{c^it^mii^(D^m 

- U ^ ;5 ^ ^ pg ^fe iU ^ ^ ^-r 5 MS SEK Sr ^i- D 
[1114] ±f5ii^fi^'r-^-<-;^i^a(-*5V^■T:^®^i^T 

[0 51 ±ISiii^x-^-<-;'^3Sg(ciott^iii^co«|^ 
[me] ±teSi^7=^->^-<-;^iSm;5>{^jt^-54^tea^ 

1 ®»A;^SfP (ia^A;^^^) 



i5 



3 
7 

8 
^) 

1 1 B^7^-^-<->^ (®^ia«^^) 

2 2 1t^^*»t^f?15 

2 3 It^tiS (li^^^m^^) 

2 4 iU^ft^Se (iB^S^^g:) 



[Hi] 



[113] 



1 0- 



i 2 



I ] 




S2 1 



S 2 2 



S 2 3 
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2 S 



.2 4 



1 1 




tHunuHair SHunan-skin 



SBlack-sesBHit SSkin-segment SCoLored-segpeot 



tColor-segDeot 
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s 1 1 



NO 



NO 




S 1 2 



SI 3 



YES 



S 1 4 



S 1 5 
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